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The Center 

(■ 

The Center for Social Organization of Schools has two primary 
objectives: to develop a scientific knowledge of how, schools affect 
their students, and to use this knowledge to develop better school 
practices and organization. 

The Center works through three research programs to achieve Its 
objectives. The School Organization Program investigates how 'scV-^ol 
and classroom organization affects student learning and other outcomes* 
Current studies focus on parental involvement, microcomputers, use of 
time in schools, cooperative learning, and other organizational factors* 
The Education and Work Program examines the relationship between schooling 
and students* later-life occupational and educational success* ^Current 
projects include studies of the competencies required in the workplace, 
the sources of training and experience that lead to employment, college 
students* major field choices, and employment of urban minority youth* 
The Q/elinquenc^ and School Environments Program researches the problem 
of crime, violence, vandalism, and disorder in schools and the role that 
Schools play in delinquency. Ongoing studies address the need to develop 
a strong theory of delinquent behavior while examining school effects on 
delinquency and evaluating delinquency prevention programs in and outside 
of schools* 

The Center also supports a Fellowships in Education Research Program 
that provides opportunities for talented young researchers to conduct 
'and publish significant research and encourages the participation of 
women and minorities in research in education. 

This report, prepared by the School Organization Program, examines 
the general issue of school effects by comparing the cognitive test 
performance of students v;ho drop out after their sophomore year with 
students who graduate. 



Abstract 

Although much hae been written about the inef fectivenesa of 
•choolt in imparting cognitive skills^ there is little reliable 

«i" ■ 

knowledge by which to judge such claimst While the typical school ^ 

, ■» 

effectiveness study focuses on variation in educational outcomes 
between organizational units, there have^lTeen few studies which 
compared "school" and **Qon-6choo 1" populations.* The purpose of £his 
paper is to assess the contribution of formal schooling to cognitive 
development. Using data from the sophomore cohort of the High School 
and Beyond project, we compare patterns of cognitive development for 
graduates and dropouts over a two year interval. With the effects of 

■ ? ■ 

social background, sophomore test performance, and prior academic 
adjustment controlled, the average difference in cognitive test 
performance that may be attributable to the effect of staying in 
school is about one-tenth of a standard deviation. Moreover, dropping 
out of school has its most severe negative effects upon disadvantaged 
students. 

. V • 
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For Whom the School Bell Tolls: 
The Impact of Dropping Out on Cognitive Perfornuince 

After a period of relative neglect » education again haa afiauined a 

prominent posit; -jn in the forefront of the public policy agenda* Blue 

ribbo^ report a on the crisia in education have been offered in abundance 

(National Commission on Excel lence» 1983; Task Force on Education for 

Economic Growth, 1983; Twentieth Century Fund» 1983» National Science Board 

Copaission, 1983)| paroposals for school reform have either been passed or" 

are under development in most state legislatures (Walton» 1983; Fi8kc» 

1982f), and the rhetoric from Washington made education policy a major iaaue 

in. the* recent election. In stark contrast t the education agenda of »juat 

** , 

a few years ago, however, today's central concerns have little to do with 
equity issues and the failures of our educational system vis-'a^via 
minorities. Rather, they involve largely matters cf school qualityi and in 
particular, the supposed failure of our schools to produce graduates who/ 

can cope with the occupational requirements and the exigencies of everj^/ay 

I 

life in a world of high technology., Declinir.g test scores, watered-*down 
mathematics and science curricula, and disturbingly high levels of both 
functional and scientific i 1 literacy are ^he kinds of issues that loom 
large in compendia af today's most pressing educational problems. 

The purpose of the present analysis is to evaluate whether our schools 
actually are as ineffectual in imparting cognitive skills as curjrei^t 
opinion seems to take them to be. Si.nce so many claim already to /know the 
answer 9 one might well ask if there really is cause for such ah^/appraisal. 
In fact, however, there is not at present a reliable knowledge/base by 

which to judge the cogency of these concerns regarding the effectiveness of 

/ 

American schools^ 

7 '\ 



, .This is not to deny that probletns exists 1 Rather lAhere is ample 
evidenci} from national testing data that many 'yotmt^ers finish high school 
with cognitive skills well below any reasonable 6ti^d)ard of adequacy. And 
VG surely are not wanting for studies that evaluate how test perfotmance 
responds to organizational variations both between and within schools. As 
is veil known, early studies found school-to-school differences in ..^-X^ 
cognitive outcomes to be very small when relevant input characteristics of 
students were taken into account. Although this literature was read 'by 
many as mp lying that schools don't make a difference, this is not quite 
correct. Such results indicate that schools with comparable .students 
_^ generally exhibit comparable achievement levels, implying that school 
differences are not terribly import it. They do not tell us, though, what 
xhe situation would be in the absence of institutionalized education. 

To determine, the impact of Bcbooling itself requires a quite different 
approach from that of the typical school' effectiveness study. In such 
research attention focuses on the variation in educational outcomes 
(frequently, test scores) t,hat ifi located between organizational units, be 
t*hey schools, schoo 1 districts, classrupms within schools, high school 
£k tracks, primary grade ability groups,, etc. Such inquiry addresses quite 

\ ■ ' N ■ ■ • ' . 

important issues, for when it is done well it can •^re veal which 
organizational arrangements produce the best perjEormance, the potential 
benefits that might be realized \^om altering those arrangement Sj^ and the 
cdntribution of organizational 'differences to the variation in outcomes 
observed' among students who experience those differences. But this 
framework is exclusively introspective — it considers only the diversity in 
existing school structures. A quite different question, and one not often 
posed, is whether schooling itself serves a useful purpose.^ 
O The reason for this relative neglect of so fundamental a question is 
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not har.d to, fathom. With the deaocratization of educational acceaa and the 

♦ 

diffusion of compulsory schooling legislation, virtually all youth, at 
least in modern industrial states, attend school through the primary 
grades, and retention through the secondary level has increased 
dramatically in recent years (Meyer and Rubinson, 1975), As a practical 
matter, then, there simply are few opportunities to determine what formal 
schooling itself contributes to cognitive development, 

B\}t although such studies are uncommon, they are not entirely lacking. 
In fact, researchers have displayed uncommon ingenuity ia, attempting to 
structure "swuool"- — '*non-schoo 1" comparisons. This modest literature 
' includes studies on such diverse topics as national differences in the age 
At which children begin formal schooling, school closings during periods of 
war or other natural disaster, add the effects of alternate day or 
alternate semester schedules in remote areas. Some of this material is 
reviewed by Husen (1972). 

^ The most recent, and perhaps most compelling, such inquiry is Heyn^s 
(1978) comparison of cognitive development during tlie^ summer months against 
that observed during the school year. Her study population consisted of 
fifth and sixth gradet^s from the Atlanta city public schoolr, whose 
academic progress was monitored for eighteen months. This period 
encompassed three test administrations, two in the fall at the beginning of 
successive academic years and one in the spring toward the end of the first 
year. Heyns reasoned that since most youngsters did not participate in 
formal academic programs during the summer, 9nd certainly none as extensile 
as during the regular school session, the summer months could be thought of 
as an extended interruption of schooling. With this clever insight, she 
was able to take a rather unexceptional set of data and put it to quite 



exceptional use » and by so doing; document an important facet of the impact 
of schooling which had gone unnoticed in scores of conventionfri school 
effectiveness studies* 

f 

Reyns found that cognitive development va tinif<^ throughout the 
eighteen month period and, most critically, that it differed strikingly for 
advantaged and disadvantaged youngsters. Whereas whites exhibited growth 
throughout the year, the average performance of minority youngsters 
improved only during the school year. In fact, among minority youth test 
scores actually declined over the summer months. This general pattern of 
black -white differences was observed at most economic levels. Although the 
growth xate for minorities during the school year still fell short of that ^ 
observed for whites, the disparity thei» was quite suall relative to when 
schools were not^in session, during which time the trends actually moved in 
opposite directions, with the scores for ^blacks declining, on average, and 
those for white ontinuing to advance. Heyns also determined that these 
differences were not attributable Co more extensive summer school 
participation by whites. In fact, they were not much explicable by any of 
the many measures of summer experience she was able to consider. 

What Reyns* analysis reveals is that schools do,, in fact, play an 
important constructive fole in fostering cognitive tie ve lopment, especially 
for disadvantaged minqjities. Schooling, in effect, compensates partially 
for cognitive deficits in the home and community environments of 
disadvantaged youngsters; by implication, were it not for the schooI^s 
intervention, the gap between the test scores of advantaged and 
disadvantaged youngsters would be even greater than it is observed to be. 

It ii^ important to appreciate that these effects of schooling only are 
apparent when out-of-schoo 1 patterns of growth are compared against those 
observed during the school year. Heyns* study thus offers reason to 
^ IQ 



believe that a^hools actually accomplish a good deal acre than is generally 
appreciated, and these accomp lie^hments would not be revealed in f.he typical 
school effectiveness study. 

The present inquiry follows Heyns' lead in comparing "in-schoo 1" with ^ 
"out-of-schoo 1" cognitive^ development, but there the similarity ends. 
Rather than concern ourselves with test performance during the prifiary 
grades, we fbcus on cognitive outcomes at the secondary level. And rathpr 
than use the academic calendar to root out naturalistic variation in 
exposure to schooling, we turn to drppouts as our 'Sinschoo led" compari^son ^ 

- ^ " . i 

grov^p. 

This focus is, we think, especially timely. Most critical commentary 
regarding the current crisis in education has been directed toward 
deficiencies at the seco'ndary level, and it cieems to us quite important to 
know whether this widespread perception of failure is valid. The situation 
of dropouts, moreover, /is of intrinsic interest as a point of comparison. 
It is well known that high school dropouts fare poorly in the labor i&arket 
(King, 1980), although it is less clear to , what extent this is due 
exclusively to lack of schooling (Olneck, 1979). In any event, we know ' 
that numerous campaigns have been mounted oyer, the years to encourage high 
risk youngsters to stay in school and get their diplomas, yet practically 
nothing is known regarding the non-economic consequences attending such 
decisions. Our analysis will reveal whether, and to what extent, dt^opc^uti 
suffer intellectually as a result of their withdrawal from school. At the 
individual level, such consequences would affect both the quality of daily 
life and one's economic and career prospects. At the collective level, ' 
they would have implications for our national stock of "intellectual 
capital" and all the issues upon which such cognitive capacity b«2ars. (See 



the report of the National Commission on Excellence in Education, 1983| for 
one aateasment of how such cognitive dif f iciencies jeoperdixe the national 
interest.) ^ 

Our baaic approach will be to compare patterns of cognitive 
development oVer a two year interval, with the sprinVof th.e sophomore year 
of high school serving as our benchmark. Our research makes use of data 
from the sophomore cohart of the High School and Beyond (HSB) project. 
This nationally representative sample was first tested in 1980 as 
sophomores, and the same battery of tests was re'-'administered tvo years 
later in the spring of 1982. The. HSB fieldvork involved extensive efforts 
to secure information from dropouts and transfers as veil as youngsters vho 
si^^yed in school, and as a result this is one of the few large scale panels 
than can claim to be representative of an actual class cohort. 

The HSB test hi ery includes assessments in several generic skill 
areas (e.g., vocabulary, mathematics, and reading) as veil as several tests 
that are more closely tied to curriculum coverage (e.g., science ^ writing, 
and civics). For the tvo year interval covered by these data, our analysis 
will estimate the *'va lue-&dded" in CQgnitive performance that can be 
attributed to persistence in school. If schools do, in fact, help foster 
intellectual development, then this should be revealed in superior grovth 
among youth vho stay in school. And, fol loving Heyns, if formal schooling 
is most important for the intellectual development of disadvantaged 
youngsters, then the cognitive benefits associated vith persistence in 
school should be most pronounced among minority and lov SES youth. 

METHODS 

■j 

The data for this analysis are from the High School and Beyond (HSB) 
1980 Sophomore Cohort Base Year (1980) and the First Follow-Up (1982) 

■ 12 



surveys. The HSB study originally surveyed roughly 30,000 sopbottores in 
more than 1,000 high schools across the country in the spring of 1980. The 
Ba<>e Year survey included both a questionnaire and a battery of cognitive 
tests (described more fully below). Eighty-four percent of the sampled 
students completed the sophoncr'e questionnaire, and 77Z completed the test 
battery. 

The First Follo%r-Up of the HSB Sophomore Cohort was fielded in the 
spring of 1982. Four groups of students from the 1980 Base Tsar sophomore 
cohort were identified: students still enrolled in their Base Year 
schools, dropouts, early graduates and transfers. Students still enrolled 
in their Base Year schools at the tine of the First Follov-Up were sampled 
with a probability of 1.0. The other three groups were sampled with a 
probability designed to produce a preset number of cases for the various 
school strata. The sample allocation consisted of 25,150 stil 1-in-schoo 1 
seniors, 2,601 dropouts, 1,290 transfers to nonrHSB schools, and '696 early 
high school graduates. Properly weighted, this sample projects to the 
population of roughly 3,800,000 high school sophomores of 1980.^ 

The response rate for the First Follow-Up is quite high for each of 
the four groups. The questionnaire completion rate ranged froza 88Z for the 
dropout group to 95Z for the 8till*in-8chool senior group. The response 
rate for completed tests ranged from 78Z of the dropout sample to 90Z for 
the still-*in-school sample. 

HSB administered the same battery of tests to the 1980 Sophomore 
Cohort in the spring of both the 1980 Base Year and the 198lZ First Follow^ 
Up phases of data collection. The areas covered in the tests are 
vocabulary, mathematics, readings science^ writing, and civics education. 
Mathematics is constructed as the sum of two mathematics subtests. 

13 
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Additional ly» « composite score va8 constructed as the sum of the first 
three tests (i.e.» vocabulary» matheinatics» reading). The sciencei 
vritingi and civics tests are designed to measure curriculum-specific 
achievement. For all tesfs ve employ what are referred to as ^formula** 
scores. These are rav scores (i.e.i number of items correct) adjusted for 
guessing. Further information on the HSB tests can be found in Heyns and 
Hilton (1982). 

Throughout these analyses^ all correlations invo*lving the test scores 
are corrected for attenuation due to random measurement error. 
Reliabilities for the sophomore testSi as reported by Heyns and Hilton 
(1982)» range from .53 for civics^ to .85 for the mathematics I test* From 
these figures^ the estimated reliability for the composite is «.92. Since 
reliability estimates for the follov-^up instruments are not yet available! 
as an expedient ve assume that the reliabilities are constant across the 
two administrations and apply these sophomore estimates to the senior tests 
as veil. Hovever» ve do not use the same reliabilities for dropouts as for 
graduates since cognitive tests are often less reliable for lov performers » 
and dropouts typically are lov achievers (Bachmani et al.| 1971; Pallasi 
1984). 

To determine any such reliability differences » ve turned to differences 
in the observed time 1 - time 2 stability coefficients for the tvo groups. 
First » the senior year test scores vere regressed on the sophomore year 
scores separately for the dropouts and graduates. The coefficients derived 
can be thought of as test**»retest » or stability^ measures. As expectedi 
theoe coefficients vere lover for the dropouts than for the non^dropouts 

for every test. Although ve recognize that these differences are not 
necessarily due to lover test reliabilities among the dropouts» they, 
nevertheless are consistent vith that possibility and, for present 



purposely that is what ve take them to aignify. Hence» our reliability 
correction for the dropout sample vaa derived aa the ratio of the dropout 
to »o0-*dropout stability coefficients in each cognitive domain.^ 
Procedurally then» reliabilitiea for the dropout group were derived as tht 
product of the overall reliability and its corresponding stability ratio. 
The overall reliabilities reported above are used *'as is'* for the st ill*- in- 
school group. For the dropouts^ the corrected reliabilities range from 39 
for the civics test to .74 for the writing test. The reliability for the 
test composite is .84. These are generally about .11 lover than those used 
for the graduates. 

The remaining measures^ which we use mainly as control variableSi are 

from either the sophomore questionnaire or are composite measures derived from 

♦ 

several sources. 

Region of country is represented as three dummy variables: NEASTi for 
the Northeast; NC| for the Horth Central llegioi?; and SOUTH» for the South. 
The ommitted region is the West. 

Race/ethnicity is represented as two dummy variables. BLACK is coded 
1 if blacky 0 otherwise. HISPANIC is coded 1 if Hispanic^ 0 otherwise. 
The omitted group is non-black non-*Rispanics. Students who classified 
themselves as both black and Hispanic are coded as Hispanic. 
Race/ethnicity is derived from the HSB composite race item which uses all 
available information from both the Base-Year and First Follow-Up 
questionnaires. 

Sex (SEX) is coded 1 if female and 0 if male. 

Socioeconomic status (SES) is an equally weighted linear composite 
of standardized measures of father^s education^ mother's educatioui 
father's occupatioui family income^ and material possessions in the 

15 
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household. 

High school grades through the sophomore year (GRADES) are self- 
reported and scored on an eight point scale, ranging from "Mostly A's" 
(coded 1) to "Mostly Belov D" (coded 8). 

ABSENCE is the self-reported number of unezcused absences from school 
in the first half of the sophomore year of high school. Kesponses range 
from "None" (coded 1) to "21 or more" (coded 7). 

RESULTS 

As a point of departure, it is of kome interest to consider hov the 
performance of dropouts on the six cognitive tests compares with that of 
youngsters who stay in school. The basic patterns of cognitive growth 
between 1980 and 1982 for those students completing high school and those 
dropping out between the sophomore and senior years can be seen in Table 1. 

Table 1 About Here 

The first five columns in table 1 present the means for dropouts and 
graduates on both the 1980 tests and the 1982 tests as well as the pooled 
standard deviations for the 1980 test. The sixth, seventh, eighth, and 
ninth columns of table 1 are derived from the first five columns. These 
display patterns of change within groups (columns eight and nine) and 
differences in performance levels between groups (columns six and seven) • 

It should come as no surprise that dropouts perform much more poorly 
on these tests than youngsters who stay in school. It is of interest^ 
howeveri that these disparities already are quite pronounced before the 
dropouts have withdrawn from school. As column six shows, the differences 
in mean scores on the 1980 tests for graduates and dropouts range from 
U66 points on the civics test to 7*135 points on the math test, 
Expressed as fractions of a standard deviation, these differences seem 



11 

t^uite largBi ranging from .513 on tne civics test to J32 on the oath test. 
Comparing the figures in column seven vith those^in column six suggests 
that to a considerable extent the differences observed two years later 
' retlect simply the persistence of the pre-*dropout pattern. The relative 

stability of pjbiese differences between the tvo groups is quite importanti 
and our formal analyses vill have to be sensitive to it« At the same time, 
however I the fact that in each case the difference between the graduate and 
dropout scores has increased slightly may be quite telling. 

This pattern of differential growth is perhaps easier to see in the 
last two columns. Both groups of youngsters improve their test performance 
over the two year interval, but the improvement is consistently greater for 
. " ' youth who stay in school. The gains in cognitive achievement for dropouts 

on individual tests range from .570 points on the science test to 1.550 
pointu on the vocabulary test. In terias of standard deviation units, these 
range from .062 on the math test to .310 on the civics test. The 
correspondiuG gains for graduates range from .943 points on the science 
test to 2.165 points on the vocabulary test. Expressed in standard 
deviation units these range from from .198 on the math test to .417 on the 
civics test. The patterning of group differences generally is quite 
consiutfiut: for five of the six tests the graduate gains are between U 
and 1.7 times those of the dropouts. On the math test, however, the 
graduate Increment is much more substantial, being 3.2 times that of the 
dropouts. Clearly then, cognitive growth is somewhat greater among youth 
who stay in school. 

« 

r 

We might also consider these differences as fractions of a year's 
"growth". As a standard of comparison, we assume that a year's growth is 
one-half of the difference between the 1980 and 1982 test averages for * 

^ particular group io « partictdar domain. Taking the test composite for 

ERIC 17 
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purposes of illustration, we divide the difference between the change in 

the test performance of dropouts and that of graduates (2.477) by one-half 

of the change in the dropout scores between 1980 and 1982 (2.900/2 " 

1.450). This tells us that -the increase of graduate performance over 

dropout performance on the composite is about 1.7 years of dropout growth. 

Following the same procedure, but using graduate growth as the frame of 

reference (5.377/2 ■ 2.689), this same difference turns out to be about .9 

years. In general, the superior growth evidenced by graduates equals about 

one year at the graduate rate and almost two years at the dropout rate. 

Thus, while the differences in the patterns of change in cognitive test 

performance between the two groups appear small in relation to the initial 

differences between the groups, they seem rather substantial when 

considered in relation to the expected annual change in the. test 

3 

performance of either group. 

Our formal analysis will attempt to isolate what portion of this 
greater growth is attributable to persistence in 'School as distinct from 
differences in the kinds of youngsters found in the two groups. We know 
that the differences in cognitive test performance of the dropouts and the 
graduates are highly consistent over the two year interval. This makes it 
particularly important that changes in cognitive performance be evaluated 
net of the kinds of background and performance characteristics known to 
differentiate students who leave high school early from those who graduate 
(Rumberger, 1983). Doing so should effectively isolate the contributions 
schooling to the patterns of change observed in Table 1. This is the 
intent of the analysis reported in Table 2. 

Table 2 About Here 

Columns A through G of Table 2 present the results of multiple 

18 
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regression analyses relating student bacjkground characteristics and 1980 
test scores to performance on^ the 1982 cognitive tests^ separately for 
dropouts and graduates. Column A, identifies the test domain being 
considered. Column B lists the predictor variables included^ the 
analyses. Columns C, D, and E contain the means i the unstandtrdined 
regression coef f icients^ and the for the analyses conducted using \he 
dropouts in the sample. Columns F| G, and H contain the same data for the 
analyses conducted using the graduates in the sample. 

In— t-hes€- data» a bout fouri:een percent of the >cohort is identified as 

having dropped out of high school sometime between the spring of the 

* sophomore year and the spring cf the senior year. This is a bit lover than 
national figures would lead us to expect, but the RSB design misses thosa 
youngsters who drop out at the first opportunity to do so (i.e«, at the end 
of compulsory (^hool attendance, or the beginning of tenth grade in many 
states) as well as those who don't withdraw until just before graduation. 
We don't know what fraction of the actual dropout population would fall iu 
each category, but the latter group probably consists largely of youngsters 
who realize that they are not going to graduate and decide not to ''stick it 
out."^ These sources of slippage notwithstanding, the profile of the 

dropout group is very much as would be expected. As already sho%mi the 

> 

dropouts are, on average, low achievers. This ' reflected in their test 
scores, as veil as in differences in self-report ! grade point average 
(that for the dropou^ group being in the '^ange of mostly C's", vhile the 
graduates average between 'Snostly B's" and "about half B's and half C's'O. 
Additionally, the dropouts display somewhat lower commitment to schooling 
even before dropping out, as indicated by their higher levr Is of 
absenteeism during the first semester of the sophomore year. The absence 
"averages" in Table 2 correspond to an average of about five days for 

19 
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dropouts, as compared with an average of two days for the graduates. The 
standard deviation for the dropout group (1.63) also is much larger than 
that for the graduate group (1.17), reflecting the disproportionate number 
of chronic truants in this group. (Incidentally, the averages differ 
somewhat from panel to panel in Table 2 because of minor differences in . 
missing data patterns across the HSB tests. Our analysis sample consists " 
of the unweighted cases with non-misaing values for all the variables in a 
particular equation.)^ 

In addition to these academic differences, we also observe 
substantial, if not especially surprising, differences in the social 
backgrounds of these two groups of youngsters. They are disproportionately 
from lower status households.^ In terms of racial/ethnic composition, the 
most striking feature is the over-representation of Hispanic youngsters: 
the dropout sample is between eighteen and nineteen percent Hispanic, 
compared to about twelve percent of the graduate sample. In comparison, 
blacks comprise only about twelve percent of the dropouts compared with 
between ten and eleven percent of the graduates. Recall, however, that 
youngsters wlio identified themselves as both black and Hispanic are 
..classified as Hispanic for purposes of this analysis. About eight percent 
of the youngers c lassified as Hispanic also identify themselves as black.^ 

Finally, we also observe some interesting regional differences in the 
composition of the two groups. The South, historically, has lagged behind 
other regions of the country in the educational attainments of its 
citizdnry, and this is reflec^d in the over-representation of dropouts 
from this region, with about All being from this area compared with 33X of 
graduates. In comparison, graduates are relatively more numerous in all 
other regions.^ 20 
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These quite substantial differences in the sorts of {youngsters vho 

i 

comprise the dropout and graduate samples underscore ourjpoint made 
previously that a proper consideration of the contributicjo of schooling to 
cognitive development must take account 6f differencies that vould be 
anticipated from other, cogritively relevant, factprs. flo make the 
appropriate comparisons, ve employ the technique of regifession 
standardization. / 

Columns I through N in Table 2 present the results of a partial 
decomposition of the regre^^sion results reported in Columns D and G« 
Column I presents the prp' i >d mean scores on the se^kior year cognitive 
tests implied by the use ^i.e mean scores of the dr/opout population on 
the predictor variables together with the regression coefficients for the 
graduates. In other words. Column I provides an indication of hov the 
dropouts would score on the senior year cognitive tests if they had 
continued in school as the graduates did (and realized the same cognitive 
"returns" on their various personal resources and chacteristics as realized 
by the graduates and as reflected in their slope estimates). Comparing the 
mean scores predicted in Column I with those actually observed for the 
dropouts and reported in the first column of Table 1 provides an indication 
of the improvement that would have been expected had the dropouts in the 
sample remained in school. This is the goal of most programs designed to 
reduce the dropout rate. 

The results of this comparison are presented in Column K as points on 
the cognitive teste i and in Columji M as standard deviation units. The 
differences in t£st scores range from .264 on the reading test to .808 on 

^ V 

J 

the writing test. On the test composite this difference is 1.477 points. 
Expressed as standard deviation units, the differences range from .04 on 
the math test to .20 on the civics test. For the test composite the figure 
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is .08. 

Columns J, L, and N of Table 2 present the results of this same type 
of na lysis using the mean scores of the graduate sample together vith the 
regression coef f icients^^f or the dropout sample. In other voi^dsi the 
.figures in Ctflumn L provide an indication of hov those in tl^e graduate 
sample would have fared on the senior year test if they had left school 
when those in the dropoirt sample did. The figures in Columns L and N are 
computed in the opposite direction as those in Columns K and M so that a 
positive figure always indicates the advantages realized by graduates as a 
result of staying in echooX. In Column L the differences in test scores 
range from -.027 on the civics test to 1.295 on the math test. On the test 
composite this difference is 2.071 points. These correspond to differences 
(reported in Column N) oi^ from -.01 standard deviations on the civics test 
to .13 standard deviations on the math test# On the test composite this 
difference is .12 standard deviations. 

Columns M and N present perhaps the most central results of this 
analysis. The average difference in cognitive test performance between 
dropouts and graduates that is not attributable to the predictor variables, 
and thus presumably attributable to the effect of staying in school, is 
about one-tenth of, a standard deviation. 

Recall that this benefit of schooling is derived with sophomore levels 
of test performance controlled, along with two important measures of prior 
academic adjustment and commitment: grade performance through the tenth 
grade and number of absences in the previous semester. Such measures 
control not only for developed competencies up to the period of our 
evaluation., but also differences of motivation and habit that likely are 
quite essential to academic success. What we see, then, are contributions 
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of schoolitig that are entirely independent of such attributea, making thia 
not only a proper, but alao a atringent, aaaeaament. Schooling thua 
appears to benefit youngatera vho peraiat academically by about a Tenth of 
a standard deviation, on average. While there ia conaiderable apread abotft 
this value, in practically all domains at leaat one of the tvo aaaeasmenta 
produces a difference at or near the .10 threahold. In fact, ve think it 
noteworthy that the largest gains to be antici ated for dropouta by staying 
in school appear on tvo of the cur r icu lum- linked testa (i.e. civica and 
yiiting). These are .20 and .16 standard deviations, respectively. Tfajia 
pattern is consistent with the interpretation of these differencaa aa being 
due to lack of formal schooling per se. 

The findings thus far address our concern with the general effecta of^ 
schooling on students, but as indicated earlier, ve are alao intereated in,, 
how the decision to leave or remain in schgiol affects particular groupi of 
students. An examination of the regre88i|6li coefficients for dropouts and 
graduates presented in Columns D' and G Q>f Table 2 allows us to consider 
this issue. ' / 

The most striking detail of theii'e regression results is the extremely 
high stability observed for the togliitive traits themselves. In ever^r 
instance the time 1 - time 2 regression coefficient borders on unity, and 
in a few instances it actually is on the high side of that boundary. T^ese 
results are due in part to our; corrections for random error in the tests, 
and the close correspondence of the stabilities for the dropout and 
graduate samples follows directly from our use of an additional correction 
factor for the former group.^ But ' - adjustments, we believe, are quite 
proper. The high stabilities they . *jduce presumably reflect an important 
feature of cognitive deyelopment: that the patterning of such traits is 
highly structured by the time youngsters reach late adolescence and not 

-23. 
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ouch changed thereafter. The fact that levels of cognitive performance are 
well established tf^ the middle of high s^chool, and the selative ranking of 
youngs'ter's pr^actical ly invariant thereafter, is an important realisation 
that must be cotsidered by those who hold expectations for effective 
educ^ational interventions. We will return to this issue in our concluding 
comments; for now, though, we mention it simply as an important backdrop to ^ 

* ^ 

our Other results. 

Inflight of such extraordinary stability over the period spanned by 
our data, even small effects of schooling and of schoo 1 'experiences might 
be considered noteworthy, and we see ample indication of such. Our two 
school-related predictor variables, number of unexcused absences in the 
first half of the sophomore year and high school grades through the 
sophomore year, identify groups of students with histories of truancy and 
poor grades, respectively.' On four pf the six tests truants who drop out 
obtaiu lower test scores than truants who do not drop out. Only on the 
reading and math tests do truants who drop out obtain higher scores than 
those who stay in school. Among students with a history of poor grades, 
the pattern is more consistent. The negative impact of poor grades is 
greater for those who stay in school than for those who drop out for each 
of the six tests. The mixed pattern of effects for truants i fleets the 
fact that both those truants w^io drop out and those who graduate experience 
the negative effects of missing in-school time, while the consistent trend 
for poor grades suggests that the discouraging effects of these grade 
evaluations only weigh upon those who stay in school. We think it - 
noteworthy that these indicators of poor academic adjustment prior to our 
baseline observation continue to take their toll on coghitive growth even 
when sophomore test performance is^eld constant.- ^Hence. even vith the 
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extremely high levels of test stability observed in these data, student 
motivation and commitment still make a difference. ^ 

Turning to the Bocial background characteriatici, it ia Hiapanic 
youngstera ,vho are most adveraely affected by dropping out of acbool. For 
five of the six tests and for the teat compoaite t|ie negative impact of 
being Hispanic is greater among the dropouts than a^ng the graduatea. The 
negative coefficients for dropouts are typically Cvo to three times as 
large as those for graduates. 

Student^s vith lov socioeconomic status also seem to be particularly 
affected by dropping out of school. On^ five of the six tests the impact of 
socioeconomic status is greater among the dropout sample than among the 
graduate sample.^^ The results for blacks and for males-female differences 
are more mixed , but at least in terms of SES comparisons and the 
consequences among Hispanic youngsters there is some indication that 
dropping out of school has its most severe effects upon the disadvantaged. 

This is in line vith the pattern observed for primary grade youngsters in 

/ 

Heyns* study of summer leijtning. 

* DISCUSSION 

The question ve addressed in this paper is vhether the cognitive 
performance of youth is improved as a result of their being in school. Our 
strategy was to compare the test performance of high school dropouts vith 
that of youngsters who persisted in school at least through the end of 
their senidr year. At the simplest level i the ansver to our question seems 
clear: the cognitive skills of youngsters who stay in school improve more 
than those of dropouts^i and this advantage is observed across a rather . 
broad range of skill areas. Additions lly^ there is reason to think that 
the benefits vhich derive from schooling are greatest for curricu4um- 
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specific competencies and for certain categories of dsad^vantaged 

t 

youngsters, specifically Hispanic and low SES youth. 

tn light of the very rigorous 'assessnenjt ' permitted by our reeearch 
design, we are inclined to have considerable confidence in these 
conclu^iox^. What is less clear from the evidence, though, is whether 
these advantages are important in any educational ly nieaningfu.l sense. Thie 
is more a matter of judgment than fact, and determining the significance of 
a pattern of small differences is a chronic difficulty in school 
effectiveness research. The average differencfe in test score gains between 
dropouts and graduates waa on the order of .10 standard deviations, which 
by a commonly used rule of thumb is right at the threshold of substantive 
significance. However, there are several reasons for thinking that these 
modest effects actually are indicative of quite important school 
influences. Although these considerations go beyond the evidence itself, 
we nevertheless think them reasonable extrapolations. 

In the first place, it should be. recalled that these modest 
differences were observed in the face of. extremely high over-time- stability 
in the underlying traits— most of our adjusted stability coefficients 
approached unity. It thus would seem that we have assessed the impact of 
schooling at a developmental stage when prospects for effective 
intervention are not at ©11 promising. But the influence of schooling; is 
not limited to late adolescence or to the last two years of high school. 
Rather, youngsters are exposed to the institutional environment of the 
school from the primary grades onward, and there is discussion in many 
areas of lowering the age of school entry even further. Since the 
cognitive benefitn of schooling are apparent under the least favorable 
circumstances, even greater impact probably should be expected during the 
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ear Ilex grades, when the traits themselves presumably are more fluid and 
receptive to experiential influence* If what ve are observing is the end 
product of a cumulative, and decelerating, process, which seems to us quite 
reasonable, then the overall contribution of schooling to levels of 
cognitive development may veil be quite substantial* 

iSecond, our tests involve mainly generic skills and curriculum-- linked 
assessments that are quite broadly applicable* This is entirely 
appropriate given the scope and intent of the HSB project* Hovever, such 
skills assessments likely understate the importance of schooling for the 
development of cognitive competencies* It is reasonable to expect that 
formal exposure to learning opportunities vill be qf much greater 
consequence for subject-speLif ic and'^curriculum-specif ic achievements* 
There can be little doubt that systematic exposure to many subjects and 
areas of knowledge occurs routinely only in school, and it seems likely 
that being in school would have a much greater impact in these kinds qf 
areas than on the more generic skills tapped in the HSB battery* In 
neglecting such centrally important considerations, our analysis most 
surely is a conservative evaluation of the influence of schools* 

Finally, the policy implied by our conclusion that schools have a 
meaningful impact on cognitive performance, i*e*, developii programs to 
encourage adolescents to complete high school, is likely to have larger 
positive effects than those shown in our present analysis* Some of the 
very students who are most likely to leave school early, (i*e*, low SES and 
Hispanic students), are those upon whom contiuued formal schooling confers 
the most benefit* Since our analysis calculates the benefits of schooling 
for a vide**-ranging sample of students, this is yet another reason to 
suspect that our figures underestimate both the gains that might be 
realized from policies which encourage and enable those students who 
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presently drop out to complete high schooli as veil as the cognitive 
contributions of schooling more generally. 

Regarding the situation of dropoutSi it is a perverse irony that many 
current proposals for improving the quality of public education by raising 
standards and adding" requirements may actually have the effect of pushing 
even greater numbers of youth out of high school before graduation (McDilli 
NatriellOi and Pallas, 1985). If implemented without consideration of such 
unintended consequences, proposals for increased standards run the risk of 
actually depressing the aggregate gains in cognitive performance associated 
with schooling. 

These are difficult and complicated issues that deserve fuller 
treatment than they can be accorded at prer.:> and ve mention the issue of 
dropout prevention merely as one policy issue for vhich our results might 
have Implications. We actually believe that some of the proposals for 
school reform could accomplish considerable good (Alexander and Pal las i 
1984), although ve hardly think any of them either comprehensive or vholly 
satisfactory as a blueprint for revitalizing the American education system. 
We also vould think it a most velcome development vere such scrutiny to 
rekindle a national commitment to school improvement that is properly 
appreciative of the many and varied responsibilities shouldered by our 
schools. The critical commentary surrounding our schools, though, rarely 
attempts a balanced appraisal of the good against the bad, and this is 
where the broad implications of our analysis come in. Our results indicate 
that scu^oling, as it is presently structured, plays an important role in 
fostering cognitive grovth. We think this an important realization, vhich 
tends to be lost sight of in our preoccupation vith the generally modent 
variability that is manifest in Bchool-tO'-^schoo 1 differences and vitl ^ 
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distreesingly lov average levels of cognitive performance that are 
prevalent. Even under the severe conditions imposed in our present 
analysis, the effects of schooling persist. Schools, then, do make 
difference, and this deserves recognition* 
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FOOTNOTES 

1. Qur ana lysis uses Che HSB weighting factor for cases having panel 
testing data. 

2. On the chance that background controls might partially proxy the 
very differences iq which ve were intere8t6d> *ve ala.-) tested 
whether these different stability coefficients became more similar 
wihen other background controls were included in the equations. They 
did not. Hence, ve retained the zero-order stabilities as the basis^^ 
for, the differential reliability estimates. 

3. We have found both the standard deviations and the year's "growth" 
scores useful bases of comparison in considering differences in 
the 1980 and 1982 cognitive scores for graduates and dropouts. The 
former provide some idea of the size of these differences in light 
oi the existing natural variation at one point in time, while the 
latter provide a sente of the size of the differences compared to 
possible change over time. 

4. Thifl group represents about two percent of the seniors. 

5. The sample weights are proportional to the unweighted N, so that 
the weighted sample size is equal to the unweighted sample tise. 

The sample size for the analyses involving the graduates ranges from 
17,343 to 18,531; that for the analyses involving the dropouts ranges 
from 2,414 to 2,637. 

38 , ■ 



29 



ERIC 



6. .The SES bompos^ite is scaled to have a pooled sample mean of zero and 
standard deviation of about .7. It has five components, each scalti 
to a mean of zero and standard deviation of one, and is constructed 
of the mean of the non^issing components. The dropout average SES 

level is more than one-half of a standard deviation belov that of 

•) 

the graduates. 

7. In 1982 blacks comprised 16 .IZ of the school-age population, vhlle 
Hispanics comparised 8.0Z of the school-age population (National 
Center for Educational Statistics, 19'83). 

8. The South consists of the South Atlantic, East South Central, and 
West South Central census regions which range from Delaware to 
Texas. 

9. The uncorrected zero-*ordor stability coefficients for tbe two groups 
(dropouts/graduates) are as follows: vocabulary (.675/ #794) , reading 
(.633/. 726), math (.689/. 833), science (.635/. 730), writing (.665/. 718), 
civics (•365/.493), test composite (.784/. 883). 

10. In their research comparing cognitive perfonnance in public and private 
schools, Coleman, Hoffer, and Kilgore (1982) have interpreted such 
slope differences as indicative of a "common school" effect (i.e. 
smaller slopes implying greater equality across racial/ethnic and 
socioeconomic groupings). In light of the widespread disparagement 
of^ublic schools in the present climate, the "uncommon school effect" 
might be a more apt characterization for the lesser dependency of test 
scores on these background characteristics among graduates. 
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